Quality Assurance of Image Registration Using Combinatorial Rigid Registration Optimization (CORRO)

Research Article | DOI: https://doi.org/10.31579/2640-1053/076

Quality Assurance of Image Registration Using Combinatorial Rigid Registration Optimization (CORRO)

  • Afua A. Yorke 1*
  • Gary C. McDonald 2
  • David Solis 3
  • Thomas Guerrero 4

*Corresponding Author: Afua A. Yorke, Department of Radiation Oncology, University of Washington, Seattle, WA, 98195.

Citation: A A. Yorke, G C. McDonald, D Solis, T Guerrero. (2021) Quality Assurance of Image Registration Using Combinatorial Rigid Registration Optimization (CORRO). Cancer Research and Cellular Therapeutics. 5(2); Doi: 10.31579/2640-1053/076

Copyright: © 2021, Afua A. Yorke, This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: 06 April 2021 | Accepted: 03 May 2021 | Published: 14 July 2021

Keywords: combinatorial rigid registration optimization (corro); reference data, and joint entropy

Abstract

Purpose: Expert selected landmark points on clinical image pairs to provide a basis for rigid registration validation. Using combinatorial rigid registration optimization (CORRO) provide a statistically characterized reference data set for image registration of the pelvis by estimating optimal registration.

Materials ad Methods: Landmarks for each CT/CBCT image pair for 58 cases were identified. From the landmark pairs, combination subsets of k-number of landmark pairs were generated without repeat, forming k-set for k=4, 8, and 12. A rigid registration between the image pairs was computed for each k-combination set (2,000-8,000,000). The mean and standard deviation of the registration were used as final registration for each image pair. Joint entropy was used to validate the output results.

Results: An average of 154 (range: 91-212) landmark pairs were selected for each CT/CBCT image pair. The mean standard deviation of the registration output decreased as the k-size increased for all cases.  In general, the joint entropy evaluated was found to be lower than results from commercially available software. Of all 58 cases 58.3% of the k=4, 15% of k=8 and 18.3% of k=12 resulted in the better registration using CORRO as compared to 8.3% from a commercial registration software. The minimum joint entropy was determined for one case and found to exist at the estimated registration mean in agreement with the CORRO algorithm.

Conclusion: The results demonstrate that CORRO works even in the extreme case of the pelvic anatomy where the CBCT suffers from reduced quality due to increased noise levels. The estimated optimal registration using CORRO was found to be better than commercially available software for all k-sets tested. Additionally, the k-set of 4 resulted in overall best outcomes when compared to k=8 and 12, which is anticipated because k=8 and 12 are more likely to have combinations that affected the accuracy of the registration.

Introduction

The central aim of radiation therapy is to maximize the dose to the tumor volume while minimizing the dose to the surrounding healthy tissues [1,2]. During a session of radiation treatment it is standard practice to verify the patient’s position with respect to the planning CT images by registering a cone beam CT image (CBCT), taken while the patient is in the setup position, to the CT planning image, taken much earlier at the start of the treatment planning. The registered CBCT/CT image pair can then indicate to the therapist the proper table positioning shifts necessary to best align the patient with the desired alignment of the treatment plan.

In spite of this alignment verification process it is difficult to ensure that each radiation port is being delivered as planned. This is due to several complicated factors such as patient movement, positioning, and the tumor size and shape, which can change during the course of treatment. This results in inter-and intra-fractional motion which can lead to over-or-under-dosing the intended target and the organs at risk (OAR) [2, 3, 4]. For these reasons, several methods have been developed to validate and characterize the quality of image registration [5].

Traditionally physicians have qualitatively validated registered images by visually inspecting portal images and diagnostic quality images alongside a planning digitally reconstructed radiograph (DRR) [6].This method of assessing image registration quality typically involves the use of an in-field metric (graticule mounted to the MV treatment head) to locate anatomical structures shared between the portal image and the DRR, in most cases this involves measurement of a point relative to unique features of the bony anatomy. The accuracy of this method has been reported to be between 5 to 10 mm [7]. This type of registration is subjective and will not be feasible for large quantities of data [8].

Fiducial markers strategically placed in/on internal targets or OARs have also been used to find the ground truth of a rigid image registration [5] Due to the poor contrast of the prostate relative to the surrounding soft tissue and the increased visibility of gold fiducial markers in kV or MV X-ray imaging, intra-prostatic gold markers are used to improve targeting for surgical procedures and radiotherapy treatment to the prostate and to estimate registration error [9-12].Though fixed to the target anatomy, the fiducials are known to drift from their original fixed point either due to anatomy changes over time or detachment of the fiducial. The effect of fiducial relocation may lead to inter-observer error associated with the registration [13-15]. Also, the number of fiducials that can be fixed at any time is limited. O’Neill et al [16]. described that in a study of 427 patients undergoing intensity modulated radiation therapy using fiducial markers for image guided radiation therapy (IGRT) the intra-fraction motion was found to be greater than 2mm for about 66% of their patients.

Expert positioned landmark points pairs have also been used to quantitatively validate registration quality. These landmark points are used to find the ground truth in correlated images which allows for validation based on the accuracy of the manual or automated selection of the points [17-19]. However, the quality of the landmark points must be validated. One metric for validating the quality of landmark points is the calculation of inter-and-intra-observer variation. This measurement is performed by requesting multiple experts to repeat the manual point selection of landmark points on the same data set multiple times [20]. For example, Shearer et al [21]. evaluated causes of error in landmark-based data collection using microCT and surface scanners. In their study, they measured the precision, accuracy and repeatability of craniodental landmarks. Their results showed that inter-observer error is of greater concern than intra-observer. Also, Fagertum et al., [22] showed the inter-observer error of 73 selected facial landmarks selected to be between 0.11-5.75 pixels. This validation method depends on how well the expert identified the points within each paired image set and the limited number of unique anatomical features from which corresponding sets of points can be selected with confidence.

Mutual information is a metric that has been successful in performing registration between clinical images and can also be used as a metric for characterizing registration quality, especially those from different modalities [23,24]. Mutual information is a concept from information theory, which is applied to image registration to measure the amount of information one image contains about the other. The registered images are validated using the following comparison metrics: the root mean squared (RMS) difference of intensities of the two images, median-absolute deviation of the intensity difference, and maximum intensity differences [25]. 

One disadvantage of CBCT imaging is that large amounts of scattered x-rays may enhance the noise levels in the reconstructed image and ultimately affect the contrast of the image. This noise is increased for thicker anatomical regions such as the pelvis making CT/CBCT image registration a very difficult problem. 

In this study, we present an offline quality assurance technique for image registration using a curated and statistically characterized reference data set of pelvic cases, each consisting of expert placed landmark points, CORRO registration values, and the original CT/CBCT image pairs from radiation therapy (RT) patient set-up for pelvic cases. We employ a method of joint entropy to quantitatively measure CORRO as we discussed in [26]. 

Materials and methods

Image Data
Fifty-Eight patients treated in the pelvic region at the Beaumont radiation oncology center were selected for a Beaumont Research Institutional Review Board approved retrospective study (2014-326). Each patient received a planning CT on a 16-slice Philips Brilliance Big Bore CT scanner (Philips NA Corp, Andover, MA) covering the entire anatomic region and utilizing immobilization devices. Each patient had CBCT images acquired for daily image guidance on the on-board imager for Elekta Synergy® linear accelerator (Elekta Oncology Systems Ltd., Crawley, UK). The CBCT images ranged from 512 × 512 × 88 to 512 × 512 × 110 pixels with pixel size ranging from (1 × 1) mm2 and 3mm slice thickness to (0.64 × 0.64) mm2 and 2.5mm slice thickness. The planning CT was resampled to the same in-plane dimensions as the CBCT and the image content was shifted to place the anatomic isocenter at the center of the image volume shown in Figure 1. The machine isocenter is located at the center of the CBCT reconstruction image volume. Figure 1a shows the planning CT image with machine isocenter in red and image isocenter in blue; Figure 1b shows the planning CT at machine isocenter and Figure 1c shows CBCT at machine isocenter.

Figure 1. Content of planning CT shifted to the machine isocenter.

Rigid-body Registration

Given the planning CT (P) and the CBCT (Q), we calculated the transformation Q=T(P) such that the corresponding coordinates in the two images correspond to the same physical location in both images. Let  and 

Formula

denoted the collection of points in 3D space

Formula

 with the same size, with P representing landmark points in the planning CT image and Q representing corresponding landmark points in the CBCT image. The registration problem in three-dimension (3D) consists of finding the transformation that achieves the best match between the corresponding features in and Q such that the root mean square (RMS) distance, 

Formula

, between corresponding points is minimized [11,27]. The appropriate translation vector is simply the mean displacement between the two sets of points [10]. The aim was to find the errors associated with locating the landmark points. The image registration problem is reduced to a shape analysis problem or to the orthogonal Procrustes problem [10-11, 28-29]. The Procrustes problem is simply a least square-fitting problem and studies have shown that the calculation of the rotation matrix R is more involved due to the non-linear condition for a rotation matrix to be orthogonal. If P and Q are replaced with their “centered” values i.e. their values less the mean values then the optimal transformation is represented as 

Formula
Formula

This reduces the problem to the orthogonal Procrustes problem where we seek to find the rotation R. The RMS distance to be minimized is termed as the fiducial registration error (FRE) [10-11].Therefore given four non-coplanar points for a 3D volume the problem of rigid-body registration is to finding a rotation and translation (t) that minimizes the FRE which is represented mathematically as 

Formula

An FRE value of zero means the rigid-body registration is perfect. However, the fit will be approximate due to variations associated with the location of landmark points and we aimed to find the error associated in locating these landmark points. The translation is given by

Formula

Where the bar indicates a mean over i=1,…,k.  

Landmark selection and generation of large k-Sets

An in-house MATLAB-based software interface named ASEMPA (Assisted Expert Manual Point Selection Application) was developed to aid experts in manually selecting landmark feature pairs between the images. An average of nearly 150 landmark pairs were selected between each CT/CBCT image pairs. The anatomical landmark pairs selected were used to generate the k-set. A k-combination set was generated as a subset of the landmark pairs by combining k-number of landmark pairs without repeat. We call the set of all possible distinctive k-combinations that form the set of discrete independent trials the k-set. Three different sizes of k-combination set were used in this study k=4, 8 and 12. 

Combinatorial Rigid Registration Optimization (CORRO)

CORRO as discussed earlier is a recently developed method that uses the rigid registration generated by members of the k-set to calculate average registration values for the image pair as a whole. The average registration values calculated by CORRO closely approximate the lowest entropy registration possible for the two images.

To improve the quality of the final registration output from CORRO a screening process was developed to remove landmark points from the original landmark set which would result in poor registration quality. This was performed by first generating the k-set of k=4. A rigid registration is then computed for each k-combination set in the k-set and an FRE is calculated for each rigid registration. The registration transformation matrix associated with the minimum FRE, Tmin is then used to create the boundary condition of Tmin ± 2mm (± 2pixels shifts for 1 pixel/mm cases). This boundary condition is then applied to all calculated registration values to extract the registrations that are within tolerance and their respective k-combination sets. The union of all landmark point pairs from these filtered k-combination sets form, a new filtered landmark point set which is then used for CORRO. Effectively this removes landmark points of poor quality (1-30 points depending on the case and original quality of landmark placement) from the original data set, which is similar to point filters used in other fields such as remote sensing [30]. The filtered landmark location of these combination pairs is used to find the k-combination set for k=8 and k=12 which is then used for CORRO.

 In generating the k-combination set, we were able to create a large population of rigid registration values capable of mapping between the CT/CBCT image pair. Using k-sets with such a large population of k-combination sets we estimated the true mean of the rigid-registration values (optimal registration) and use the central limit theorem to validate our results. The results were also validated using joint histogram and joint entropy calculation. The joint histogram of two registered images is less dispersed when the images are well aligned and the corresponding anatomical features overlap. The near perfect alignment in the joint histogram results in a low joint entropy value.

Results

Image Data, Landmark pairs and k-combination sets

An average of 154 (range: 91-212) bony landmark pairs were selected for each CT/CBCT image pair. Large k-sets for k = 4, 8 and 12 were generated and used to solve for the rigid-body registrations. The size of each k-set ranged from 2,000 to 8,000,000 k-combination sets. Table 1 shows 10 of the 58 cases included with our reference data set. The number of landmark pairs created for each case, the number of unique k-combination set generated for all k-values are shown in columns 5 and 6. 

Table 1: CT images, summary of landmarks and k-combination set for each CT-CBCT image pair. The image and voxel dimensions are shown for all the cases used in this study.

Rigid-Body Registration and Joint Entropy

Applying the mean translation for combination k=4 for one of the CBCT cases the output registration is demonstrated by fusing the planning CT and CBCT to see how well the rigid registration performed. Figure 2 shows the joint histogram of the registration from the x-ray volumetric imaging software (XVI). The mean registration from CORRO was applied to the CT/CBCT pair and the joint histogram was plotted and shown in Figure 2 for k=4, k=8, k=12 and XVI.

The joint entropy of the planning CT and CBCT combination by targeting only the tumor regions for all cases was used to validate the results. This result is shown in Table 2 and the pie chart results in Figure 2 and the linear plot in Figure 3. Joint entropy has been discussed fully in our previous publication [26].

Estimating and Validating the Optimal Registration Using Central Limit Theorem

The mean standard deviation of the registration output decreased as the k-size increased for all cases. Calculating the joint entropy of all 58 cases validates the final results; a sampling of 10 cases is shown in Table 2. In general, the joint entropy evaluated using CORRO was found to be lower than results from XVI.

Table 2: Joint entropy of registered images from XVI and rigid registration using k-set of 4, 8, and 12. An asterisk indicates lowest joint entropy.

Of all 58 cases 58.3% using k=4, 15% using k=8 and 18.3% using k=12 resulted in the best registration using CORRO as compared to 8.3% of cases using the commercial registration software as shown in Figure 3. The joint entropy between the registration output from k-set of 4 versus k-set of 8, 12 and the commercial software were compared with correlation coefficient of 0.9989 for 4 and 8, 0.9988 for 4 and 12 and 0.9947 for 4 and 12.

 The minimum joint entropy for one of the cases was calculated and found to exist at the estimated registration mean as shown in Figure 6.

Figure 2: Percentage comparisons between registration outputs from k-set of 4,8 12, andXVI.
Figure 3:  Joint entropy comparison between the registration output from k-set of 4 versus k-set of 8, 12 and XVI.

The k-set gives a large population of paired sets of points, (k-combination set) when we draw a large sample from the population of k-set then the distribution of the sample mean approaches a normal distribution, and the standard deviation of the sample mean decreases as the sample size increases. 

The normal distribution for one case for k-set of 4 is shown in Figure 4 and the standard deviation, which is proportional to

Formula

, where n is the sample size is demonstrated in Figure 5. It should be noted that for this particular case the estimated registration mean (population mean) is -2.3608 pixels for x-translations and the mean of the sample mean is also -2.3608 as expected by the central limit theorem. In Figure 6a, the Joint entropy distributions for over 400,000 individual transformations for a sample case. The minimum joint entropy is at the estimated mean and minimum joint entropy of 6.4004 at RMS value of 32.11, which is close to the estimated mean for this sample, is 31.7397. Figure 6b shows the Joint entropy distributions of a random sample of 5000 individual transformations for the same sample case. The minimum joint entropy is at the estimated mean and minimum joint entropy of 6.4646 at RMS value of 31.4, which is close to the estimated mean for this sample, is 31.6369. 

To further prove that the joint entropy will always have a value close to the estimated mean we randomly sampled 1000 individual transformations shown in Figure 6c for the same case. The minimum joint entropy was again found to exist close to the estimated mean and minimum joint entropy of 6.4651 at the three RMS values which leads us to conclude that the sample has to be large in order to get the minimum joint entropy at just one RMS value.

Figure 4: Distribution of sample mean for an example case (case 1).
Figure 5: The distribution in figure 5 was used to validate sample sizes ranging from 100 to 300,000 and their sample standard deviation (pixels) is plotted. The difference for sample size of 500 is also shown.  For this image 1pixel=1mm.
Figure 6: Joint entropy for a) distributions for over 400,000 individual transformations for a sample case. b) Distributions for 5000 randomly sampled transformations for same case. c)  Distributions for 1000 randomly sampled transformations for the same case. The line shows location of smallest joint entropy value.

Discussion

Rigid body registration algorithms have been historically evaluated using geometrical features. Points and surfaces are most commonly used in the evaluation process. In this study, we created a data set for pelvic cases and statistically characterized this data using a methodology we developed called CORRO. Using landmark points identified by expert and employing the statistical method of combination without replacement we generated thousands and millions of landmark point sets for each case and estimated the true mean of the rigid registration and the registration error.

The results were validated using the central limit theorem. 

The results of k=4 gave the overall best results when compared to k=8 and 12, which is anticipated because k=8 and 12 are more likely to have mismatched points that would affect the accuracy of the registration [31].  If d is the number of dimensions the number of points needed to perform a registration is given by n≥d+1 and the degrees of freedom is given by n≥d2+d hence for 3D the number of points needed should be n ≥4 and the degrees of freedom is 6 for a rigid registration which has only 3 rotations and 3 translations and 12 for an affine registration with 12 degrees of freedom 3 rotations, 3 translations, 3 scaling and 3 shearing. In 3D any four points can be mapped to another four points [32]. However, more landmarks result in more transformation which result in different weighted areas of the image. Coste [33] shows that the result of using many landmarks could result in the combination of some of the points resulting in odd transformation of the image grid. This could be what happens in the case of k=8 and 12.

The result of this work found that the when large samples were drawn from the k-set the estimated error associated with the registration reduces. This means for a given k-set a large sample can be randomly drawn to perform the registration with similar results rather than using registration for the entire k-set. 

Conclusion

The results demonstrate that CORRO works even in the extreme case of the pelvic anatomy where the CBCT suffers from reduced quality due to increased noise levels. The estimated optimal registration was found to be better than results from XVI. The data created in this work will be made available to the scientific community for assessing image registration algorithms and to aid in the development of future image comparison and validation metrics. The result obtained in this study revealed that for ≥ 500 numbers of samples there are no significant differences in their registration errors as the deviation is less than a 0.01mm which is less than most clinical cutoffs.

CORRO can also be an excellent tool for radiotherapy centers in Lower Middle-Income countries or radiotherapy centers without in-room kV imaging for a retrospective quality assurance in set-up process using the MV electronic portal imaging system and digitally reconstructed radiographs. Also, the reference set can be used in future studies to test image registration algorithms. The data has been made available at

https://wiki.cancerimagingarchive.net/display/Public/Pelvic+Reference+Data)

Acknowledgement

We thank Beaumont Hospital Royal Oak MI, for their support. Also wish to thank C. K. Yorke, Ph.D., and B. J. Roth Ph.D. For their assistance and enlightening comments.

Conflict of Interests

Authors declare no financial relationships that may lead to a conflict of interest.

References

Clearly Auctoresonline and particularly Psychology and Mental Health Care Journal is dedicated to improving health care services for individuals and populations. The editorial boards' ability to efficiently recognize and share the global importance of health literacy with a variety of stakeholders. Auctoresonline publishing platform can be used to facilitate of optimal client-based services and should be added to health care professionals' repertoire of evidence-based health care resources.

img

Virginia E. Koenig

Journal of Clinical Cardiology and Cardiovascular Intervention The submission and review process was adequate. However I think that the publication total value should have been enlightened in early fases. Thank you for all.

img

Delcio G Silva Junior

Journal of Women Health Care and Issues By the present mail, I want to say thank to you and tour colleagues for facilitating my published article. Specially thank you for the peer review process, support from the editorial office. I appreciate positively the quality of your journal.

img

Ziemlé Clément Méda

Journal of Clinical Research and Reports I would be very delighted to submit my testimonial regarding the reviewer board and the editorial office. The reviewer board were accurate and helpful regarding any modifications for my manuscript. And the editorial office were very helpful and supportive in contacting and monitoring with any update and offering help. It was my pleasure to contribute with your promising Journal and I am looking forward for more collaboration.

img

Mina Sherif Soliman Georgy

We would like to thank the Journal of Thoracic Disease and Cardiothoracic Surgery because of the services they provided us for our articles. The peer-review process was done in a very excellent time manner, and the opinions of the reviewers helped us to improve our manuscript further. The editorial office had an outstanding correspondence with us and guided us in many ways. During a hard time of the pandemic that is affecting every one of us tremendously, the editorial office helped us make everything easier for publishing scientific work. Hope for a more scientific relationship with your Journal.

img

Layla Shojaie

The peer-review process which consisted high quality queries on the paper. I did answer six reviewers’ questions and comments before the paper was accepted. The support from the editorial office is excellent.

img

Sing-yung Wu

Journal of Neuroscience and Neurological Surgery. I had the experience of publishing a research article recently. The whole process was simple from submission to publication. The reviewers made specific and valuable recommendations and corrections that improved the quality of my publication. I strongly recommend this Journal.

img

Orlando Villarreal

Dr. Katarzyna Byczkowska My testimonial covering: "The peer review process is quick and effective. The support from the editorial office is very professional and friendly. Quality of the Clinical Cardiology and Cardiovascular Interventions is scientific and publishes ground-breaking research on cardiology that is useful for other professionals in the field.

img

Katarzyna Byczkowska

Thank you most sincerely, with regard to the support you have given in relation to the reviewing process and the processing of my article entitled "Large Cell Neuroendocrine Carcinoma of The Prostate Gland: A Review and Update" for publication in your esteemed Journal, Journal of Cancer Research and Cellular Therapeutics". The editorial team has been very supportive.

img

Anthony Kodzo-Grey Venyo

Testimony of Journal of Clinical Otorhinolaryngology: work with your Reviews has been a educational and constructive experience. The editorial office were very helpful and supportive. It was a pleasure to contribute to your Journal.

img

Pedro Marques Gomes

Dr. Bernard Terkimbi Utoo, I am happy to publish my scientific work in Journal of Women Health Care and Issues (JWHCI). The manuscript submission was seamless and peer review process was top notch. I was amazed that 4 reviewers worked on the manuscript which made it a highly technical, standard and excellent quality paper. I appreciate the format and consideration for the APC as well as the speed of publication. It is my pleasure to continue with this scientific relationship with the esteem JWHCI.

img

Bernard Terkimbi Utoo

This is an acknowledgment for peer reviewers, editorial board of Journal of Clinical Research and Reports. They show a lot of consideration for us as publishers for our research article “Evaluation of the different factors associated with side effects of COVID-19 vaccination on medical students, Mutah university, Al-Karak, Jordan”, in a very professional and easy way. This journal is one of outstanding medical journal.

img

Prof Sherif W Mansour

Dear Hao Jiang, to Journal of Nutrition and Food Processing We greatly appreciate the efficient, professional and rapid processing of our paper by your team. If there is anything else we should do, please do not hesitate to let us know. On behalf of my co-authors, we would like to express our great appreciation to editor and reviewers.

img

Hao Jiang

As an author who has recently published in the journal "Brain and Neurological Disorders". I am delighted to provide a testimonial on the peer review process, editorial office support, and the overall quality of the journal. The peer review process at Brain and Neurological Disorders is rigorous and meticulous, ensuring that only high-quality, evidence-based research is published. The reviewers are experts in their fields, and their comments and suggestions were constructive and helped improve the quality of my manuscript. The review process was timely and efficient, with clear communication from the editorial office at each stage. The support from the editorial office was exceptional throughout the entire process. The editorial staff was responsive, professional, and always willing to help. They provided valuable guidance on formatting, structure, and ethical considerations, making the submission process seamless. Moreover, they kept me informed about the status of my manuscript and provided timely updates, which made the process less stressful. The journal Brain and Neurological Disorders is of the highest quality, with a strong focus on publishing cutting-edge research in the field of neurology. The articles published in this journal are well-researched, rigorously peer-reviewed, and written by experts in the field. The journal maintains high standards, ensuring that readers are provided with the most up-to-date and reliable information on brain and neurological disorders. In conclusion, I had a wonderful experience publishing in Brain and Neurological Disorders. The peer review process was thorough, the editorial office provided exceptional support, and the journal's quality is second to none. I would highly recommend this journal to any researcher working in the field of neurology and brain disorders.

img

Dr Shiming Tang

Dear Agrippa Hilda, Journal of Neuroscience and Neurological Surgery, Editorial Coordinator, I trust this message finds you well. I want to extend my appreciation for considering my article for publication in your esteemed journal. I am pleased to provide a testimonial regarding the peer review process and the support received from your editorial office. The peer review process for my paper was carried out in a highly professional and thorough manner. The feedback and comments provided by the authors were constructive and very useful in improving the quality of the manuscript. This rigorous assessment process undoubtedly contributes to the high standards maintained by your journal.

img

Raed Mualem

International Journal of Clinical Case Reports and Reviews. I strongly recommend to consider submitting your work to this high-quality journal. The support and availability of the Editorial staff is outstanding and the review process was both efficient and rigorous.

img

Andreas Filippaios

Thank you very much for publishing my Research Article titled “Comparing Treatment Outcome Of Allergic Rhinitis Patients After Using Fluticasone Nasal Spray And Nasal Douching" in the Journal of Clinical Otorhinolaryngology. As Medical Professionals we are immensely benefited from study of various informative Articles and Papers published in this high quality Journal. I look forward to enriching my knowledge by regular study of the Journal and contribute my future work in the field of ENT through the Journal for use by the medical fraternity. The support from the Editorial office was excellent and very prompt. I also welcome the comments received from the readers of my Research Article.

img

Dr Suramya Dhamija

Dear Erica Kelsey, Editorial Coordinator of Cancer Research and Cellular Therapeutics Our team is very satisfied with the processing of our paper by your journal. That was fast, efficient, rigorous, but without unnecessary complications. We appreciated the very short time between the submission of the paper and its publication on line on your site.

img

Bruno Chauffert

I am very glad to say that the peer review process is very successful and fast and support from the Editorial Office. Therefore, I would like to continue our scientific relationship for a long time. And I especially thank you for your kindly attention towards my article. Have a good day!

img

Baheci Selen

"We recently published an article entitled “Influence of beta-Cyclodextrins upon the Degradation of Carbofuran Derivatives under Alkaline Conditions" in the Journal of “Pesticides and Biofertilizers” to show that the cyclodextrins protect the carbamates increasing their half-life time in the presence of basic conditions This will be very helpful to understand carbofuran behaviour in the analytical, agro-environmental and food areas. We greatly appreciated the interaction with the editor and the editorial team; we were particularly well accompanied during the course of the revision process, since all various steps towards publication were short and without delay".

img

Jesus Simal-Gandara

I would like to express my gratitude towards you process of article review and submission. I found this to be very fair and expedient. Your follow up has been excellent. I have many publications in national and international journal and your process has been one of the best so far. Keep up the great work.

img

Douglas Miyazaki

We are grateful for this opportunity to provide a glowing recommendation to the Journal of Psychiatry and Psychotherapy. We found that the editorial team were very supportive, helpful, kept us abreast of timelines and over all very professional in nature. The peer review process was rigorous, efficient and constructive that really enhanced our article submission. The experience with this journal remains one of our best ever and we look forward to providing future submissions in the near future.

img

Dr Griffith

I am very pleased to serve as EBM of the journal, I hope many years of my experience in stem cells can help the journal from one way or another. As we know, stem cells hold great potential for regenerative medicine, which are mostly used to promote the repair response of diseased, dysfunctional or injured tissue using stem cells or their derivatives. I think Stem Cell Research and Therapeutics International is a great platform to publish and share the understanding towards the biology and translational or clinical application of stem cells.

img

Dr Tong Ming Liu

I would like to give my testimony in the support I have got by the peer review process and to support the editorial office where they were of asset to support young author like me to be encouraged to publish their work in your respected journal and globalize and share knowledge across the globe. I really give my great gratitude to your journal and the peer review including the editorial office.

img

Husain Taha Radhi

I am delighted to publish our manuscript entitled "A Perspective on Cocaine Induced Stroke - Its Mechanisms and Management" in the Journal of Neuroscience and Neurological Surgery. The peer review process, support from the editorial office, and quality of the journal are excellent. The manuscripts published are of high quality and of excellent scientific value. I recommend this journal very much to colleagues.

img

S Munshi

Dr.Tania Muñoz, My experience as researcher and author of a review article in The Journal Clinical Cardiology and Interventions has been very enriching and stimulating. The editorial team is excellent, performs its work with absolute responsibility and delivery. They are proactive, dynamic and receptive to all proposals. Supporting at all times the vast universe of authors who choose them as an option for publication. The team of review specialists, members of the editorial board, are brilliant professionals, with remarkable performance in medical research and scientific methodology. Together they form a frontline team that consolidates the JCCI as a magnificent option for the publication and review of high-level medical articles and broad collective interest. I am honored to be able to share my review article and open to receive all your comments.

img

Tania Munoz

“The peer review process of JPMHC is quick and effective. Authors are benefited by good and professional reviewers with huge experience in the field of psychology and mental health. The support from the editorial office is very professional. People to contact to are friendly and happy to help and assist any query authors might have. Quality of the Journal is scientific and publishes ground-breaking research on mental health that is useful for other professionals in the field”.

img

George Varvatsoulias

Dear editorial department: On behalf of our team, I hereby certify the reliability and superiority of the International Journal of Clinical Case Reports and Reviews in the peer review process, editorial support, and journal quality. Firstly, the peer review process of the International Journal of Clinical Case Reports and Reviews is rigorous, fair, transparent, fast, and of high quality. The editorial department invites experts from relevant fields as anonymous reviewers to review all submitted manuscripts. These experts have rich academic backgrounds and experience, and can accurately evaluate the academic quality, originality, and suitability of manuscripts. The editorial department is committed to ensuring the rigor of the peer review process, while also making every effort to ensure a fast review cycle to meet the needs of authors and the academic community. Secondly, the editorial team of the International Journal of Clinical Case Reports and Reviews is composed of a group of senior scholars and professionals with rich experience and professional knowledge in related fields. The editorial department is committed to assisting authors in improving their manuscripts, ensuring their academic accuracy, clarity, and completeness. Editors actively collaborate with authors, providing useful suggestions and feedback to promote the improvement and development of the manuscript. We believe that the support of the editorial department is one of the key factors in ensuring the quality of the journal. Finally, the International Journal of Clinical Case Reports and Reviews is renowned for its high- quality articles and strict academic standards. The editorial department is committed to publishing innovative and academically valuable research results to promote the development and progress of related fields. The International Journal of Clinical Case Reports and Reviews is reasonably priced and ensures excellent service and quality ratio, allowing authors to obtain high-level academic publishing opportunities in an affordable manner. I hereby solemnly declare that the International Journal of Clinical Case Reports and Reviews has a high level of credibility and superiority in terms of peer review process, editorial support, reasonable fees, and journal quality. Sincerely, Rui Tao.

img

Rui Tao

Clinical Cardiology and Cardiovascular Interventions I testity the covering of the peer review process, support from the editorial office, and quality of the journal.

img

Khurram Arshad